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Description 

[0001 J The present Invention relates to a method of 
reducing the visual impact of defects present in a spatial 
light modulator C'SLM") display, and, more particularly, 
to a method of the type defined in th© precharacterlzing 
portion of claim 1 . 

BACKGROUND 

[0OO21 There are at least four genera of SLM's: elec- 
tro-optic, magneto-optic, liquid crystal and DMDs.The 
latter genus, DMDs, includes a mlcromechanica! array 
of electronically addressable mirror elements. The mir* 
ror elements are reflectors each of which is Individually 
movable. Each mirror is a light reflecting pixel and is ca- 
pable of mechanical movement in response to an elec- 
trical input Ught Incident on each mirror may be modu- 
lated in its direction (or phase) by reflection from each 
mirror. To date, DMO SLMs have found use in applica- 
tions such as optical correlation, spectrum analysis, 
crossbar ©witching, frequency excision, display projec- 
tion, printing and neural networks, 
[0003] There are several species of the genus "DMD 
SLM", including elastomertype, membrane type as well 
as cantilever-beam, torsion-beam, and flexure-beam 
typee. Selective control, oraddressing, of the DMD SLM 
pixels has been achieved by electron-beam input, opti- 
cally or, as preferred today, by circuitry integrated onto 
the DMD eubstrate- 

[0004J Each pixel of the DMD SLM array reflects inci- 
dent light along a path which depends on the position 
ororientation of the pixel. Typically, each mirror is mov- 
able or deflectable between a normal, first position or 
orientation and one or more second positions or orien- 
tations. In only one pos&ior, either the norma] position 
or one of the second positions, a mirror directs the inci- 
dent light along a selected path to a primary light-receiv- 
ing site, for example, into an optical system and from 
there onto a viewing surface or a photosensitive drum. 
In all other pixel positions, Incident light Is not directed 
along the selected path to the primary site; rather, it is 
directed along another path to either a secondary site 
or to a "light sink" which absorbs or eliminates the light 
[00051 ADMDmaytaketheform of asquare, ornearly 
square, array of mirrors. In this event, the positions of 
the pixels, each of which is individually controllable by 
associated addressing facilities, may be altered to gen- 
erate a video presentation. See commonly assigned US 
Patents, 5,079,544; 5,061,049; 4,954,789: 4,728,165 
and 3,600.798. See also US Patents 4,356,730; 
4,229,732; 3,896,338 and 3,S8$,310. The mirror array 
may also taKe other forms, for example, that of a linear 
array or an array with many more columns than rows, 
the length of which is much larger than its width. In this 
latter event, the positions of the mirrors, as determined 
by their associated addressing facilities, may be altered 
so that the reflected light prints characters in quasi-line- 



at-a-time fashion on a photosensitive drum. Se© com- 
monly assigned US Patents 5,101 ,236 and 5,041,851 . 
In both events, and in other use environments, appro- 
priate configurations of mirrors enable DMDs to modu- 
s late light In amplitude-dominant or phase-dominant 
modes. 

[0006] It has been found convenient to produce inte- 
grated addressing circuits monolith ically with the mirrors 
using conventional MOS processlngtechniquestoform 

10 the addressing circuits in and on a substrate (e.g., sili- 
con orGaAs) with the mirrors thereabove. The address- 
ing circuits may be planarized and overlain by their re- 
spective mirrors to limit light penetration to the circuitry 
and to minimize the device size. Depending on the de- 

1 5 vice type and the addressing voltages applied, the pixel 
may be addressed in analog, tristabte, or bistable (bina- 
ry) fashion. 

[0007] A membrane type DMD SLM indudes a met- 
allized polymer membrane stretched over a spacer grid 

20 or other support structure. The openings In the grid de- 
fine modulator cells or elements which comprise an ad- 
dress electrode and a portion of the polymer membrane 
supported by the spacer grid. The spacer grid effects an 
air gap or separation between segments of the mern- 

2B brane and the corresponding underlying addressing 
electrodes. When an address electrode of an address 
circuit is energized, by applying a bias voltage to the 
address electrode, the normally flat related membrane 
segment is curvilinearly deformed out of its normal, un- 

so stretched, planar position by electrostatic attraction be- 
tween the membrane and the address electrode, and 
Into the air gap where it now acts as a miniature spher- 
ical mirror. This deformation stores potential energy in 
the deformed membrane. When the address electrode 

35 is deenergized, the potential energy stored by the mem- 
brane returns the membrane to its normal flat position. 
Incident light reflected by each miniature spherical mir- 
ror is concentrated into a relatively narrow cone that is 
rotationally symmetric about the specularly reflected 

40 light The pixel array can , therefore, be associated with 
a Schlieren stop, which comprises a single, central ob- 
scuration having a position and size to block the image 
of the light source that results from specular reflection 
by flat or unmodulated pixels. Modulated or spherically 

43 deformed pixels direct a circular patch of light onto the 
plane of the stop; the patch is centered on, but is larger 
than, the stop's central obscuration and. therefore, 
traverses a selected direction and reaches a selected 
site, 

so [0008] Membrane DMDs have also been produced by 
forming an array of relatively thick, separated, flat mir- 
rors supported on a relatively thin porymer membrane 
above a silicon or other substrate. The underlying ad- 
dressing circuits formed on and in the substrate are sep- 

55 arated by air gaps from their associated pixels when the- 
latler reside in their normal positions. When an address- 
ing circuit is appropriately energized, Its mirror or pixet 
is displaced or deflected toward the substrate by eleo 
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trostatfc attraction. The mirrors remain ftat while the 
membrane immediately surrounding them stretches to 
permit the mirrors to deflect up-and-down in piston-like 
fashion. The resultant displacement pattern produces a 
corresponding phase modulation pattern tor the reflect- 
ed light This pattern may be converted into analog in- 
tensity variations by Schlieren projection techniques or 
used as the Input transducer for an optical information 
processor. Further information on membrane type 
DMDs may be obtained from commonly assigned U.S. 
Patent 4.441 ,791. 

[0009] Beam-type DMDs each comprise a relatively 
thick (for rigidity) mirror or metal member supported by 
one or more relatively thin (for compliance), integral 
beams or springs. Each mirror and its beam(s) is struc- 
turally supported above and separated from its associ- 
ated addressing circuit and an address or control elec- 
trode which is a part of the addressing circuit, by aepac- 
er or support post which supports the beam. 
[0010] I ri the absence of a deflecting force applied to 
the mirror or metal member, the beam maintainsthe mir- 
ror in a normal, generally horizontal position parallel to 
the substrate. When the address or control electrode is 
energized by having a voltage applied thereto by the ad- 
dressing circuitry, a portion of the mirror aligned with the 
electrode along the lines of the resulting electrostatic 
field is electrostatically attracted toward the electrode. 
Cantilever arroVor torsional bending occurs preferential- 
ly atthe thin beam{s). Such bending stores potential en- 
ergy In the beam(s) associated with a deflected mirror 
The stored potential energy, which tends to return the 
mirror to its normal position, is effective to return the mir- 
ror when the control or address electrode no longer at- 
tracts It. 

[00111 Wh " e * e present invention may prove useful 
relative to all types of SLM's it finds particular utility with 
beam-type DMDs. improper operation of these types of 
DM D"s typically involves one or more mirrors of the array 
becoming ■stuck" and remaining in a fixed position re- 
gardless of the operation of the applicable addressing 
circuits. A mirror may become stuck in either the "on" 
position, the position whereat incident Gght is reflected 
onto a viewing surface, or an "or position, a position 
whereat incident light is not reflected onto the viewing 
surface. Pursuant to theforegoing nomenclature, a mir- 
ror or pixel which is stuck in the "on 0 position will cot> 
tinuousty reflect light to the viewing surface as a contin- 
uous "bright spot," even when the pixel should be "off", 
i.e. should be transmitting no lightto the viewing surface. 
Moreover, a mirror or pixel which is stuck in the "off po- 
sition will not reflect light to the viewing surface, resulting 
in a continuous "dark spot" even when the pixel should 
be -on" and transmitting light to the viewing surface. 
These undesired. Improper, bright and dark spots are 
referred to herein as "defects.'' 
[0012] Defects in DMD displays are, as a minimum, 
annoying to the viewer. They produce on-going light or 
dark regions which persist regardless of visual changes 



occurring to the remainder of the display. At worst, such 
defects may prevent the display from presenting mean- 
ingful visual information. Due to the manner in which 
DMD SLM's are manufactured, it is not possible to gain 
s access to pixels which are stuck for pu rposes of render- 
ing them operative. Moreover, pixels which are property 
operative when a DMD SLM display is first put into serv^ 
Ice may later become stuck. The reverse is also possi- 
ble, that Is. previously stuck mirrors may become un- 
to stuck. 

[0013] A method Df the type mentioned in the begin- 
ning is known from WO-A-91/15843. This document 
teaches adding a compensation signal to at least one 
pixel to compensate for a defective pixel. 

16 

SUMMARY 

p014J According to the present invention there is pro- 
vided amethod as mentioned in the beginning and corn- 
so prising the features of the characterizing portion of claim 

[0015] The present invention provides a method for 
reducing the visual impact of defects present In an im- 
age display. The display Includes an array of pixels. 
23 each non-defective pixel being selectively operable in 
response to input data by addressing facilities between 
an "on- state, whereat light is directed onto a viewing 
surface, and an "off 1 state, whereat light is not directed 
onto the viewing surface. A defect is the result of a de- 
so fective pixel which does not respond to the input data 
presented by the addressing facilities, typically by con- 
tinuously remaining in Its M on a or "off state. The address- 
ing circuit-determined value of a compensation pixel te 
changed from its desired or intended value, to a correc- 
ts tive value, in order to reduce the visual Impact of the' 
defect. 

[001 6] In one embodiment, the values of the compen- 
sation pixels are adjusted by adding an offset to the de- 
sired value of each compensation pixel. A scaling func- 
40 tlon based on the sine function is used to determine the 
offset applied to the compensation pixels. 

BRIEF DESCRIPTION OF THE DRAWINGS 

• 45 [DOIT] FIG. 1 is a timeline according to the prior art 
showing one frame period comprised of eight separate 
sub-frame periods. 

flK>1 8] FIG. 2 is an array of pixels, having an orthog- 
onal or Manhattan format, showing the location of da- 
so fective, compensation, and reference pixels. 

[0019] FIG. 3 is a matrix of intensity values to be dis- 
played on the pixel array of Figure 2. 
[0020] FIG. 4 is the matrix of the intensity values of 
Figure 3 that has been modified according to one err> 
55 bodiment of the present invention to minimize the impact 
of a defective pixel. 

[0021] FIG- 5 is the matrix of the intensity values of 
Figure 3 that has been modified according to one em- 
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bodlment of the present invention to minimize the Impact 
of a defective pixel. 

[00221 FIG. 6 is a plot of the since funcjion. 
[0023) FIG. 7 is the matrix of the intensity values of 
Figure 3 that has been modified according to one em- j 
bodimenlofthe present invention tominimizethe impact 

of a defective pixel. 

[0024] RG. 8 Is the matrix of the intensity values of 
Figure 3 that has been modified according to one em- 
bodiment of the present Invention to minimize the Impact 
of a defective pixel. 

[0025] FIG. 9 is the matrix of the intensity values of 
Figure 3 that has been modified according to one em- 
bodiment of the present invention to minimize the impact 
of a defective pixel. 

[0026] FIG. 1 0 is the matrix of the Intensity values of 
Figure 3 that has been modified according to one em- 
bodiment of the present Invention to minimtzethe impact 
of a defective pixel. 

[00271 F,e - 1 1 * the ^frk of * e intensity values of 
Figure 3 that has been modified according to one em- 
bodiment of the present invention to minimize the impact 
of a defective pixel. 

[0028] FIG. 12 is the matrix of the intensity values of 
Figure 3 that has been modified according to one em- 
bodiment of the present invention to minimize the impact 
of a defective pixel. 

[0029] FIG. 13 is a matrix of intensity values having 
an intensity gradientthat are to be displayed on the pixel 
array of Figure 2. 

[0030] FIG. 1 4 is the matrix of the intensity values of 
Figure 13 that has been modified according to one em- 
bodiment of the present invention to minimize the impact 

of a defective pixel 

[0031] FIG. 15 Is the matrix of the intensity values of 
Figure 13 that has been modified according to one em- 
bodiment of the present Invention tominimize the impact 
of a defective pixel. 

[Q03£] FIG. 1 fi is the matrix of the Intensity values of 
pgure 1 3 that has been modified according to one em- 
bodiment of the present invention to minimize the impact 

of a defective pixel. 

[0033] FIG. 1 7 is the matrix of the intensity values of 
Figure 13 that has been modified according to one em- 
bodiment of the present invention to minimize the Impact 
of a defective pixel. 

[0034] FIG. 1 8 Is an orthogonal array of pixels show- 
ing one possible correspondence between reference 
pixels and compensation pixels according to one em- 
bodiment of the present invention. 
[0035] FIG. 1 9 Is the matrix of the Intensity values of 
Pgure 13 that has been modified according to one em- 
bodiment of the present invention to minimize the Impact 
of a defective pixel. 

[0036] FIG. 20 Is the matrix of the Intensity values of 
Figure 13 that has been modified according to one em- 
bodiment of the present invention to minimize the Impact 

of a defective pixel. 
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P037] FIG. 21 is an orthogonal array of pixels show- 
ing another possible correspondence between refer- 
ence pixels and compensation pixels according to one 
embodiment of the present invention. 
5 [0038] FIG. 22 is a matrix of intensity values that has 
been modified according to one embodiment of the 
present invention to minimize the impact of three defec- 
tive pixels. 

[0039] FIG. 23 is an array of pixels, having a stag- 
to gered, cardinal or brick format, showing the location of 
defective, compensation, and reference pixels. 
[Q04O] FIG. 24 is an array of pixels, having a hexag- 
onal format, showing the location of defective, compen- 
sation, and reference pixels. 
is [0041] FIG. 2Sls an staggered array of pixels showing 
one possible correspondence between reference pixels 
and compensation pixels according to one embodiment 
of the present invention. 

[004q F,s - 26 fe an ^flared array of pixels showing 
20 another possible correspondence between reference 
pixels and compensation pixels according to one em- 
bodiment of the present invention. 
[0043] FIG. 27 is an hexagonal array of pixels show- 
ing one possible correspondence between reference 
25 pixels and compensation pixels according to one em- 
bodiment of the present invention. 
[0044] RG. 28 is an hexagonal array of pixels show- 
ing another possible correspondence between refer- 
ence pixels and compensation pixels according to one 
30 embodiment of the present Invention. 

[004S] FIG. 29 is a block diagram of a display system 
according to one embodiment of the present Invention. 
[00461 FIG. 30 is a block diagram of a display system 
according to one embodiment of the present invention 

39 including an optical projection path and an optical de- 
tector in a feedback path. 

DETAILED DESCRIPTION 

40 [0047] in one type of DMD display, multiple video im- 
ages are projected, typically at the rate of 50 to 60 
frames per second, In order to give a viewer the effect 
of true motion. Each frame represents a complete 
•'snapshot" or -frame-grab" of the image being dis- 

43 played. As discussed earlier, the DMD elements or mir- 
rors of a bistable DMD modulator may only assume one 

• of two positions, on or off. and the duty cycle of each 
modulator element within a frame is modulated in order 
to project gray scale Images. Typically this is done by 

so dividing each frame period 1 00 into multiple sub-frame 
or "bit-plane" periods 102, 104, 10G, 108 as shown in 
Figure 1 . Generally, the data displayed during each bit- 
plane within a frame is unique. The eye and brain of the 
viewer tend to integrate the multiple bit-planes to create 

55 a frame, much the same way that multiple frames are 
integrated to achieve the effect of full-motion video. 
[0048] The simplest way to produce bit-planes from a 
binary-encoded word representing the desired Intensity 
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of a pixel, or intensity word, is to use each bit of the In- 
tensity word to create one bit-plane. Each bit will then 
control the position of the mirror for one sub-frame or 
bit-plane. Generally, the time each bit of the intensity 
word controls the mirror position is doubled for each in- 
crease in bit significance. For example, the most signif- 
icant bit is displayed during sub^rame 102, the next 
most significant bit te displayed during sub-frame 104, 
the period of which is half as long as the period of sub- 
frame 1 02. Each successive sub-frame is displayed for 
half the period of the previous sub-frame until all the 
sub-frames have been displayed. This causes the inte- 
grated displayed intensity to be a linear representation 
of the intensity word. One sample time-line for an eight- 
bit display system is shown in Figure 1 . Throughout this 
discussion intensity data values will be represented as 
eight-bit values, but ft should be understood that the 
methods taught herein are equally applicable to other 
word lengths. Although Figure 1 shows the sub-frames 
displayed in order from the most significant 102 to the 
least significant 108, practical systems typically do not 
display the data bite in descending order, nor is each 
sub-frame period necessarily contiguous. For example, 
in some display systems, portions of multiple bit planes 
are displayed simultaneously such that at any given 
■ time, different portions of the array are displaying data 
bits of various significance. Further information on split- 
ting bit-planes is contained in commonly assigned U.S. 
Patent 5,278,652. 

[0049] Specifically, assume that a selected mirror or 
pixel has, during a frame period, me following positions: 
on on, off, off, off. on, off, on.This sequence of positions 
can be represented by the eight bit binary number 
11 0001 01 having a decimal equivalent of 197. The 
number 197 may be thought of as the grey scale value 
of the pixel as evaluated by the human eye/brain during 
the frame. If this same pixel is stuck on, the defect pro- 
duced thereby will have a continuous grey ecale frame 
valueof 255; if It is stuck off, the defect's value will beO. 
rposo] Study and analysis of DMD displays have pro- 
duced some significant observations. First, amelioration 
of the effect of defects can occurwhen the condition, on 
or off, of a mirror in the vicinity of an improperly operating 
mirror is appropriately adjusted to lessen the visual ef- 
fect of the defect 

T0051J One of the easiest ways of ameliorating the ef- 
fects of the stuck pixel, or defective pixel 202, In an array 
of pixels 200 shown in Figure 2, is to use the pixels 204 
surrounding the defective pixel 202 to compensate for 
the Increase, or decrease, in light reflected from the de- 
fective pixel 202. For example, assume that the desired 
intensity for each pixel shown in Figure 2 is equal to the 
corresponding intensity value shown In the matrix of Fig- 
ure 3. in the case shown by Figure 3, the intended in- 
tensity vaiue of every pixel is 1 BO. If the Intended inten- 
sity of the defective pixel 202 was 1 80, as shown by el- 
ement C3 in Figure 3, but pixel 202 was stuck on (inten- 
sity = 255), there are 75 bit periods of excess light rn 



each frame of the display. To reduce the excess light, 
each of the 8 pixels 204 surrounding the defective pixel 
202 is reduced by 9 bit periods, as in the matrix of actual 
intensity values shown in Figure 4. This results in the 
5 total light from the defective pixel 202 and the 8 sur- 
rounding pixels 204 being only 3 LSB periods too great 
as opposed to the original 75 periods. Because the 8 
pixels 204 surrounding the defective pixel 202 were 
used to compensate for the defective pixel 202, the 8 
10 pixels 204 are referred to as the compensation pixels 
204. Figure 5 shows the intensity values that are dis- 
played if pixel C3 is stuck off. 
[0052] In an attempt to ascertain what value imposed 
on the compensation pixel best operates to ameliorate 
19 the effect of a defective pixel, analogies were drawn be- 
tween averaging andthe operation of electrical low pass 
filters, which perform a type of averaging. Various aver- 
aging techniques derived from the type of averaging 
performed by tow pass filters wore applied to pixel frame 
so values. An effective low pass filter is one which has a 
so-called sine function characteristic, that is, the char- 
acteristic response which is congruent with the function 
generated by low pass filtering a unit impulse, which is 
given by; 



Y=(sinX)/(X), 

and is shown in Figure 6, wheT© Y is the magnitude of 
so the response and X represents the distance from the 
defective pixel 202. Tlie sine function waveform 600 is 
characterized as having a central curviliriear portion G02 
with a value of 1 and generally symmetrical, posftve- 
and negative-going, damped portions 604 on eitherside 
35 thereof. It was felt that the damped side portions 604 
might be related to an appropriate value to be assumed 
by the compensation pixel. Indeed, it was found that an 
approximation of the damped side portions is related to 
a "compensation" value which, If assigned to the com- 
40 pensationpixel204,wouldoffsetthedifferencebetween 
the actual and desired intensity values of the defective 
pixel 202, or in the alternative, between the actual Inten- 
sity value of the defective pixel 202 and the intensity val- 
ue of one or more nearby reference pixels 206 so as to 
45 ameliorate the constantly on or constantly off, defective 
pixel 202. The application of this technique and Its re- 
finement Is another object of the present invention. 
[0053] To relate the sine function to a matrix of pixels, 
the distance between orthogonally adjacent pixels iseet 
so equal to 3P/2 radians. As shown in Figure 6. for orthog- 
onally adjacent compensation pixels, X - 3P/2 radians 
andthe function evaluatesto -0.2122. For diagonally ad- 
jacent compensation pixels, X = 2*3P/2 radians and the 
function evaluates to 0.0553. 
ss [0054] There are many ways of implementing a sine 
function-shaped correction. The simplest method does 
not require knowledge of the desired Intensity of either 
the compensation pixels 204 or the reference pixels 
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206. Acceding to this first method, The unit impulse re- 
sponse (Y s* 1) is assumed to be proportional to the dEf- 
ference between the actual Intensity of the defective pix- 
el and the desired intensity of the reference pixel. The 
intensity of the compensation pixels is then determined 
according to the following formula: 



where X is the intensity value assigned to the compen- 
sation pixel 204, A is the value of the sine function eval- 
uated forthe compensation pixel. B is the actual inten- 
sity value of the defective pixel 202, and O fe the desired 
intensity value of the defective pixel 202. For orthogo- 
nally adjacent compensation pixels A= -.2122, for diag- 
onally adjacent compensation pixels A « .0568. Figure 
7 is a matrix of the actual Intensity values displayed an 
array of pixels that have the desired intensity shown in 
Figure 3 when pixel C3 is stuck on. Figure a is the matrix 
of Figure 7 when pixel C3 is stuck oft. In Figure 7, the 
average Intensity displayed by the 8 compensation pix- 
els 204 and the defective pixel 202 is 1 83 compared to 
the desired intensity of 180. In Figure 8, the average 
intensity is 179.6 compared to the desired intensity of 
180. 

[0055] As can be seen in Figures 7 and 8, the intensity 
value assigned to the diagonally adjacent compensation 
pixels is very close to the intended intensity value of the 
compensation pixels. Therefore, the diagonally adja- 
cent compensation pixels contribute very little to the 
compensation or the defective pixel 202. It is possible 
to reduce the amount of processing power required and 
still achieve approximately the same compensation ef- 
fect by only adjusting the intensity values of the four or- 
thogonally adjacent compensation pixels. Figures 9 and 
1 0 show the actual displayed intensity values forthe ma- 
trix of Figure 3 when only the four orthogonally adjacent 
pixels are used to compensate for a defective pixel 202 
that Is stuck on (Figure 9) or off (Figure 10). 
[0056] An alternate method of compensating for a de- 
fective pixel, not according to the present invention, us- 
es the same intensity value for each of the 8 compen- 
sation pixels 204, According to this method, the diago- 
nally adjacent compensation pixels are assigned the 
same value as the orthogonally adjacent compensation 
pixels. This method provides 8 compensation pixels 204 
and only requires the calculation of one compensation 
value. Figures 11 and 12 show the actual displayed in- 
tensity values, according to this method, for the matrix 
of Figure 3 when pixel C3 is stuck on (Figure 11) or off 
(Figure 12). 

[0057] While the method thus far determined the val- 
ue of a compensation pixel by using only the intended 
or desired intensity value of a defective pixel 202 and 
tne actual displayed intensity value of the defective pixel 
202, a second method involves using the actual dis- 
played intensity and the desired intensity of the defec- 



tive pixel 202 to determine an offset value which is ap- 
plied to the compensation pixels 204. While any of the 
options taught above regarding adjacent and orthogonal 
compensation pixels 204 may be used in the methods 
5 that follow, the examples illustrated will assume that ali 
8 compensation pixels 204 are treated as orthogonally 
compensation pixels. The difference between the first 
and second methods is that whereas In the first method 
the value assigned to the compensation pixels 204 was 
to determined solely by the desired and actual values of 
the defective pixel 202, the second method according 
to the present invention determines an offset based on 
the desired and actual values of the defective pixel 202 
and adds this offset to the desired value of the compen- 
» sation value according to the following formula: 

X n = A (B-C) + D n 

20 where X 0 is the intensity value assigned to the compen- 
sation pixel 204, A is the value of the sine function eval- 
uated for the compensation pixel (-.2122 in this exam- 
ple), B is the actual intensity value ot the defective pixel 
202, C is the desired intensity value of the defective pixel 
25 202, and D n is the desired value of the compensation 

[0058] This second method has the advantage of not 
losing the image information contained in the original in- 
tensity value set While the loss of the information con- 
so tained In the original compensation intensity values 
does not alter the displayed image when the desired val- 
ue for all of the pixels is equal, as in Figure 3, the loss 
does degrade an image that contained an intensity "edg- 
es' 1 or intensity "contour* as shown in Figure 13, espe- 
35 daily If the intensity contourwas accompanied by image 
motion between successive image of a video display 
system. Figures 14 and 15 show the actual displayed 
Intensity values forthe matrix of Figure 13 when the 8 
compensation pixels are offset according to the above 
40 formula to compensate for a defective pixel 202 that is 
stuck on (Figure 14) or off (Figure 15). As shown In Fig- 
ures 14 and 15, the compensation pixels 204 maintain 
the original intensity contour while being offset to com- 
pensate forthe defective pixel 202. In Figure 14, the In- 
43 tensity value of each compensation pixel 204 la de- 
creased27 while in Figure 15, the intensity value of each 
compensation pixel 204 js fncreased 27- 
[00591 Athird method, according to the present inven- 
tion, uses the surrounding reference pixels 206, that is 
so pixels A1 through AS, B1, B5, 01, 05, D1, D5, and E1 
through E5, to calculate either the value of the compen- 
sation pixels, or an offset forthe compensation pixels 
204. To assign a value to the compensation pixels, the 
following formula is used; 



X = A<B-C)+D 
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where X is the intensity value assigned to the compen- 
sation pixel 204, A is the value of the sine function eval- 
uated for the compensation pixel (-.2122 to this exam- 
ple), B is the actual intensity value of the defective pixel 
202, C is the average value of the 1 6 reference pixels 
20$, and D is the desired intensity value of the defective 
pixel 202. To compensate for a defective pixel 202 by 
offsQttingth©compensationpixete.UiefoUowmg formula 

Is used; 

X n =A(B-C) + D n 

where X,, Is the intensity value assigned to the compen- 
sation pixel 204, A is the value of the sine function eval- 
uated for the compensation pixel (-.2122 in this exam- 
ple), B is the actual intensity value of the defective pixel 
202^ C is the average value of the reference pixels 208, 
and D n is the desired value of the compensation pixel. 
An alternative to this third method uses the average val- 
ue of the 1 6 reference pixels 206 and the desired value 
of the defective pixel 202 in place of "C in the above 
formulas to determine the value of the compensation 
pixels. Figures 1 6 and 1 7 show the actual displayed in- 
tensity values for the matrix of Figure 13 when the 8 
compensation pixels 204 are offset according to the 
above formula, thereby compensating for a defective 
pixel 202 that is stuck on (Figure 1 6) or off (Figure 17). 
In Figure 16, the intensity value of each compensation 
pixel 204 is decreased 20 while In Figure 1 7 t the inten- 
sity value of each compensation pixel 204 is increased 
34. 

[0060] Although the embodiments taught above help 
to preserve information from the original compensation 
pixels 204. It still has a tendency to lose information con- 
tained In the compensation pixels 204 when there is a 
significant intensity contour or edge in the displayed im- 
age- Figure 13 showsthe desired intensity values for an 
orthogonal array of pixels 1200 displaying a Sharp in- 
tensity change between columns 3 and 4. When pixel 
C3 is stuck on, the previous algorithm calls for decreas- 
ing all of the compensation pixels 204 by 20. Because 
of thedlstinct edge between columns 3 and 4, averaging 
all of the reference pixels 206 results in decreasing com- 
pensation pixels 204 B2, B3, C2, D2, and D3 too little, 
and decreasing compensation pixels 204 B4, C4, and 
D4too much. 

[0061] A fourth method according to the present in- 
vention of compensating for defective pixels 102 while 
preserving edges and contours that may be present in 
the original intensity value data set involves the use of 
only a portion of the reference pixels 206 when calcu- 
lating the value or offset for an individual compensation 
pixel 204, As shown in Figure 16, a first method uses 
only the reference pixel 1 806 that is opposite the defec- 
tive pixel 1802 with respect to each compensation pixel 
1804. For example, only the value of reference pixel 
1606 A3 is used to determine the value of compensation 



pixel 1604 B3. Each arrow1808 in Figure 18 leads from 
a reference pixel 1806 to acompensation pixel 1804 that 
Is modified by the reference pixel 1806. Application of 
thief irst method to the intensity data set shown in Figure 
s i3resultBinthevaluesshownforthecompensation pix- 
els 204 shown in Figure 19 when pixel C3 is stuck on, 
and shown in Figure 20 when pixel C3 is stuck off. 
[00621 Although the above example used only a sin- 
gle reference pixel to derive the intensity value of a com- 
10 pensation pixel 204, any number of pixels may be used . 
One example is shown In Figure 21 which once again 
uses arrows 210B to point from a reference pixel 2106 
to acompensation pixel 21 04 that it modifies. As shown 
in Figure 15, the intensity value of each compensation 
is pixel depends on the value of three reference pixels 
21 06- Many other groups of reference pixels 21 06 may 
be used to compensate the intensity value of the com- 
pensation pixels 2104, including methods that use as 
reference pixels those pixels in the area surrounding the 
20 referenceplxels^06 t WithOUtdepartlngfromthBmeth- 

ods taught herein. 

[0063] While me preceding examples have shown tne 
compensation of the effects of defective pixels 202 that 
areisolated, it should be understood that the same com- 
25 pensatlons techniques may be used for multiple defec- 
tive pixels that are nearby or even adjacent to each oth- 
er. For example, assume that an image is comprised of 
a 6x8 array of pixels each with a desired intensity value 
of 1 80. Figure 22 shows the actual intensity values dis- 
a> played assuming pixel C3 isstuckon and pixels D5 and 
C6 are stuck off. According to the present invention, an • 
offset of -1 7 Is used to compensate for pixel C3 and an 
offset of +58 is used to compensate for pixels D5 and 
C6. Pixels C4 and D4 are used to compensate for both 
95 pixels C3 and D5. Therefore pixels C4 and D4 have a 
net offset of +22 added to the desired intensity value of 
1 80. Pixels C5 and D6 are used to compensate for both 
pixels D5 and C6, and therefore have a net offset of +76 
added to the desired intensity value of 1 80. Because the 
40 examples herein have assumed an 8-blt intensity data 
word which has a maximum Intensity value of 255, the 
actual Intensity value displayed by pixels CS and D6 is 
255 instead of the calculated value of 256. 
[0064J The compensation techniques taught herein 
45 are not restricted to the compensation of defective pixels 
in an orthogonal pixel array, but rather, the techniques 
may be easily modified and applied to a pixel array of 
any form. For example, the pixel array 2300 of Figure 
23 has raws of pixels that are staggered or shifted by 
so one-half pixel. This form of array is commonly referred 
to by several names including: brick-, staggered-, and 
cardinal-array. In Figure 23. pixel 2302 is assumed to 
be defective. According to the present invention, the pix- 
els surrounding the defective pixel 2302 are the com- 
es pensation ptxels 2304, and the pixels surrounding the 
compensation pixels 2304 are the reference pixels 

2306. _ 
p)065] A second form of pixel array that may benefit 
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from the methods taught herein is an array comprised 
of non-rectangular pixels, for example the array of hex- 
agonal pixels 2400 Shown fn Figure 24. In Figure 24, 
pixel 2402 is assumed to be defective. Once again, the 
pixels surrounding the defective pixel 2402 arethe com- 
pensation pixels 2404, and the pixels surrounding the 
compensation pixels 2404 are the reference pixels 
2406. 

[0066] The use of asubset of the reference pixels 206 
to determine the offset for a compensation pixel 204, as 
taught herein, may easily be applied to non-orthogonal 
pixel grids as shown in Figures 25 through 28. In each 
of Figures 25 through 28, arrows identify the reference 
pixels, associated with each of the compensation pixels. 
Figure 26 shows a staggered array of pixels 2500 
wherein one reference pixel 2506 is used to determine 
the offcet applied to each compensation pixel 2504. Fig- 
ure 26 shows a staggered array of pixels 2600 wherein 
three reference pixels 2606 are used to determine the 
offset applied to each compensation pixel 2604. Figure 
27 shows a hexagonal array of pixels 2700 wherein one 
reference pixel 2706 is used to determine the offset ap- 
plied to each compensation pixel 2704. Figure 28 shows 
a hexagonal array of pixels 2800 wherein three refer- 
ence pixeb 2806 are used to determine the offset ap- 
plied to each compensation pixel 2304. As stated above, 
many other arrangements of reference and compensa- 
tion pixels are possible without departing from the 
present invention. 

[0067] Although the examples used to describe the 
present invention have thus far referred to the defective 
pixel as being either stuck on or stuck off, ft should be 
understood that the present invention is also used to 
compensate for defective or Inoperable pixels whose 
output may be between fully on and fully off. For exam- 
ple, a light emitting diode (LED) or liquid crystal device 
• (LCD) display may include some pixels that cannot be 
fully illuminated or darkened, perhaps due to leakage 
currents in the underlying addressing circuitry. The ad- 
jacent pixels are then used to compensate for the inop- 
erable or defective pixel as described above. 
[0068] Figure 29 is a schematic representation of one 
example of e display system 2900 according to the 
present invention. Analog video data is sampled by an 
analog-to-digital converter 2902 and passed to a proc- 
essor 2904. The processor 2904 performs many func- 
tions such as data conditioning, gamma correction, 
deinterlaclng, and data formatting, all of which are 
known in the prior art. In addition to the existing functions 
performed by the processor 2904, the processor 2904 
also calculates and applies the offsets to the compen- 
sation pfcels according to the present invention. The 
compensated digital video data is then stored in RAM 
2906a, 2906b before being driven onto SLM 290S. 
[0069] To compensateforthedefectrvepjxels202,the 
processor 3904 may use any of the algorithms suggest- 
ed herein. Which algorithm is selected depends prima- 
rily on the amount of processing throughput available 



and the types of images being displayed. For example, 
the processor may select an algorithm that uses all of 
the reference pixels 206 to determine a common value 
for the compensation pixels when there is image motion 
5 in the vicinity of the defective pixel. This algorithm does 
not require much processing power to Implement which 
is an advantage because the processing power required 
by other processes may Increase when there is scene 
motion. Furthermore, because the human eye loses a 
10 lot of resolution when there is motion in the scene, the 
viewer te less likely to detect any defects that are gen- 
erated by a simple compensation algorithm. 
[0070] The processor determines which pixel&arede- 
fective by reading the contents of the defective pixel 
is map2910.Thelocationsofthecfefectlvepixei9202may 
be stored in the defective pixel map 291 0 when the dis- 
play is assembled. However, as mentioned above re- 
garding DMDs. there is a tendency for pixels to either 
become unstuck, or to become stuck, during the oper- 
20 aflon of the DMD. Compensation of Intermittently defec- 
tive pfcete requires that the defective pixel map 291 0 be 
periodically updated to include the locations of all pixels 
that are currently defective. A system that is capable of 
montorfng the operational condition of the pixels is 
25 shown in Figure 30. 1 n Figure 30, the light 3002 from the 
SLM 2908 passes through a beamsplitter 3004 which 
allows the majority of the light 3006 to pass through to 
display screen 3008. A small portion of the light 301 0 Is 
directed by the beam splitter 3004 toward the detector 
30 3012. In a first detection embodiment, detector 3012 is 
a detector array that has a one-to-one correspondence 
between detector pixels and SLM pixels. By monitoring 
the output of the detectorarray 3012, while images were 
being displayed, the processor 2904 determines which 
55 pixels are defective. While this embodiment uses an ex- 
pensive detector array 3012, it allows detection of de- 
fective pixels in a single image frame. An aUemalive to 
asystem 3000 using a detector array 301 2 uses a single 
detector element 301 2 to measure the light from the en- 
40 tire image, in this second detection embodiment, the 
processor 2904 must monitor marry frames to data to 
deduce which pixels are stuck. This second embodi- 
ment has the disadvantage of using a lot of processing 
powerto detect the defective pixels. A third embodiment 
45 uses a single detector element 3012 to locate defective 
pixels by displaying a dedicated sequence of video test 
frames. These test frame© may be interspersed with the 
actual image frames at a slow enough rate to be unde- 
tectable by the viewer. In television systems, the test 
so frames may be inserted during chan nel changes. Alter- 
natively, the test frames may be displayed during a serf- 
test routine that is executed whenever the system Is 
turned on prior to displaying actual Image data. 
[0071] Using a beamsplitter 3004 to direct a portion 
ss of the light 301 0 to the detector has the disadvantage of 
reducing the amount of light 3006 that is directed toward 
the screen 3008. To avoid reducing the light 3006 direct- 
ed toward the screen 30OS, the beamsplitter 3004 may 
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be eliminated and the detector3012 positioned so as to 
detect light reflected from the screen 3008. 
[0072] Thus, although there has been disclosed to 
this point a particular embodiment tor a method of re- 
during the visual impact of defects present in a spatial * 
liaht modulator display, it is not intended that such spe- 
cific references be considered as limitations upon the 
scop© of this invention except in-so-far as set forth in 
the following claims. Furthermore, having describedthe 
invention in connection with certain specific embodi- » 
ments thereof, it is to be understood thai further modifi- 
cations andpermutations may now suggestthemselves 
to those skilled in the art, it is Intended to coverall such 
modifications and permutations as fall within the scope 
of the appended claims. 



Claims 

1. A method for compensating for defects present in so 
an Image display of the type having an array (200; 
2300; 2400) of pixels, each pixel being selectively 
controllable, each defective pixel (202; 2302; 2402) 
being surrounded by nearby pixels, .the method 
comprising th e steps of: 

Identifying a defective pixel (202; 2302; 2402); 
changing an image data value for nearby pixels 
to compensate for said defective pixel (202; 
2302; 2402), characterized in that 90 
said image data value is changed tor each pixel 
(204; 2304: 2404) In afirstringcf compensation 
pixels immediately surrounding said defective 
pixel (202; 2302; 2402) by using a subset of ref- 
erence pixels in a second ring immediately sur- & 
rounding said first ring to determine a corrective 
value for a compensation pixel, given by; 

C NEW = C 6INC Pact - FW + °int 40 

where C NEW « an image value assigned to 
the compensation pixel, Cs lNC is a value of the 
SINC function evaluated for the compensation pi*- 
el, D/ict is a detected intensity value of the defective 
pixel (202; 2302; 2402), R AVG is an average value 
of at least one pixel in the second ring, a 
desired intensity value of the defective pixel (202; 
2302; 2402), and tne SINC function is defined as 
Ca^^inXyX where X represents the distance so 
of the compensation pixel from the defective pixel 
(202; 2302; 2402) with the distance of the nearest 
adjacent pixel equal to 3ic/2 radians. 

2. The method of claim 1 , wherein the identifying 55 
step is effected by compering the actual light 
directed onto a viewing screen <300fi) by the defec- 
tive pixel (202; 2302; 2402) and the desired inten- 



sity Value Of the defective pixel (202; 2302; 2402). 

3. The method of claims 1 - 2, further comprising the 
step of storing the location of the defective pixels 
(202; 2302; 2402) in a memory (2910). 

4. The method of claim 1 - 3, further comprising re- 
placing: 

D |Wr thB desfred intensity value of the defective 
pixel (202; 2302; 2402). with C 0HG , the original 
value of the compensation pixel. 



PatentansprQche 

1 Verfahren zum Kompensieren von Fehlem, die in 
einer Bildanzeige des Typs mit einer Matrix (200; 
2300; 24O0) aus Blldelementen vorhanden slnd, 
wobei Jedes BUdelement wahlwelse steuerbar ist. 
wobei Jedes fehlerhalte BUdelement (202; 2302; 
2402) von nahen Bildelementen umgeben ist, wo- 
bei das Verfahren diefolgenden Schritte umfaBt 

Identmzieren eines fehlerhaften Bildelements 
(202; 2302; 2402); 

Andem eines Baddatertwertes fur nana Bildele- 
mente, urn das fehlerhafte Bildelement (202; 
2302; 2402) ZU kompensieren, 

dadurch gekennzeichnet, daB 
der BilddaterrwertfQr Jedes Bildelement (204; 
2304 2404) in elnem ersten Ring aus Kompensa- , 
tionsbiidelementen, der das fehlerbafte Bildele- 
ment (202; 2302; 2402) unmfoelbar umgibt, gean- 
dert wird, tadem elne Untermenge von Referenz- 
bildelementen In einem zweiten Ring, der den er- 
sten Ring unmittelbar umgibt, verwendet wird, urn 
einen Korrekturwert fur ein Kompensationsbildele- 
ment 2U bestimmen, der gegeben 1st dutch: 

C NEW = C m c ( d act ' r avg> + °w 

wobei Gnew ein Bildwert ist, der dem Kom- 
pensationsbildelement zugewiesen ist, C giNC ein 
Wert der SINC-Funktion 1st, derfurdas Kompensa- 
tionsbildelementermitteltwlrd, D^ein erfafcterln- 
tensitatswert des fehlerhaften Bildelements (202; 
2302; 2402) ist, R AVfi ein Witterwert wenigstens ei- 
nes Bildelements im zweiten Ring ist, DINT ein ge- 
wOnschter IntensttStswert des f ehlematten Bildele- 
ments (202; 2302; 2402> 1st und die SlNC-Funktion 
defmiert ist durch Cs, NC = (sin X)/X, wobei X den 
Abstand des Komponsationsbildelemerrts vom feh- 
lerhaften Bildelement (202; 2302; 2402) darstellt, 
wobei der Abstand des am nichsten befindlichen 
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benachbarren Bildelernents gleich 3n/2 Radian 1st 

Verfahrennach Anspruch I,beidemdcrld©ntifi2ie- 
rungsschriltausgefOhrt wlr<J durch Vergleichen des 
tatsachlichen Lichts, das durch dasfehlerhafte BUd- 
element (202; 2302; 2402) auf einen Beobacri- 
tungsschirm (3008) gerichtet wlrd r mil dam ga- 
wQnschten Inteneitatswert deafehlertiaften Bildele- 
ments(202; 2302; 2402). 

Verfahren nach den Anspruchen 1-2, das ferner 
den Schritt des Speichems des Ortes des fehlerti af- 
ten Bildelements (202: 2302; 2402) in elnem Spei- 
cher (2910) umfaBL 

Verfahren nach den AnsprOchen 1 -3, dasfamer das 
Ersetzen von D {m , des gewOnschten Intensltais- 
werts des fehlerhaften Bildelemems (202; 2302; 
2402), durch C 0RS , den ursprunglichen Wert des 
Kompensationsbildelements, umfaBt 
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Revindications 

1. Proc6de de compensation de defauts presents 
dans un afnchage dMmages du type possedant un 
reseau (200 ; 2300 ; 2400) da pixels, chaque pbcel 
etant seleetivement comrnandable, chaque pixel 
defectueux (202 ; 2302 ; 2402) aant entoure de 
pixels voisins, le process ccmprenant les etapes 
de: 



du pixel d6fectueux (202 ; 2302 ; 2402), et la fono- 
tion S1NC est dSflnie comme etant Csjnc - (sin Xy 
X oD X represents la distance entre !e pixel da com- 
pensation ©tiap(xaldefectueux(202 ;2302 ;2402). 
la distance du pixel adjacent la plus proche etant 
egale h 3t^2 radians. 

Precede selon la revendicatlon 1 , dans lequel I'eta- 
pe dldentiflcation est effectuee en comparant la lu- 
miera reella dirigee sur un ecran de visualisation 
(30O8) par le pixel defectueux (202 ; 2302 ; 2402) 
at la valaur dlntsnsit© desire* du pixel defectueux 
(202 ; 2302 ; 2402). 

Precede salon les revendications 1 et 2. compre- 
nant en outre I'etape de stockaga de Emplacement 
du pixel defectueux (202 ; 2302 ; 2402) dans une 
rnemoire (2910). 

ProaSdeselon les revendications 1 a3, comprenarit 
en outre le remplacemerrt de D^. la valeur destree 
du pixel del ectuoux (202 ; 2302 ; 2402), par C^q. 
la valaur originate du pixel da compensation. 



26 



30 



identification d'un pixel defectueux (202; 
2302:2402); 

modification de la valeur des donnees de I Ima- & 
ge pour les pixels voisins poureompenser ledlt 
pixel defectueux (202 : 2302 ; 2402), 

eararterise en ce que ladite valaur de don- 
nees d'image est modifiee pour chaque pixel (204 ; <o 
2304 ; 2404) dans un premier anneau da pixels de 
compensation entourant imm6cfia(tement ledit pixel 
defectueux (202 ; 2302 ; 2402) en utilteant un sous- 
ensemble de pixels de reference dans un deuxieme 
anneau entourant Immedlatarnent ledit premier an- & 
neau pour determiner une valeur corrective pour un 
pixel de compensation, donnie par 



CmBV = C SINC ( D ACT ' R AVQ ) + D IWT 50 

oQ c NEW est une valeur d'image attribute au 
pixel da compensation. C SINC est une valeur de la 
fonction SINC estimee pour I© pixel da compensa- 
tion, Dact est una valeur (fintensite detected du « 
pixel dtfectueux (202 ; 2302 i 2402), n Ave est una 
valeur moyenne d'au moins un pixel dans le deuxie- 
me anneau, D INT est una valeur dMntensite desirea 
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